Reflections on TREC

Further reflections on TREC

The paper reviews the TREC Programme up to TREC-6 (1997), considering the test results, the substantive ®ndings for IR that follow and the lessons TREC o€ers for IR evaluation. The paper focuses on the ad hoc retrieval task, with discussion of other test tracks as appropriate. The paper summarises the structure of the TREC work and analyses the experimental data in some detail. The analysis of ...

Reflections on "Aboutness" TREC-9 Evaluation Experiments at Justsystem

TREC-9 evaluation experiments at the Justsystem site are described with a focus on “aboutness” based approach in text retrieval. Experiments on the effects of supplemental noun phrase indexing, pseudo-relevance feedback and reference database feedback in view of the effect of various length of queries are reported. The results show that pesudo-relevance feedback is always effective while refere...

More Reflections on "Aboutness" TREC-2001 Evaluation Experiments at Justsystem

The TREC-2001 Web track evaluation experiments at the Justsystem site are described with a focus on the “aboutness” based approach in text retrieval. In the web ad hoc task, our TREC-9 approach is adopted again, combining both pseudo-relevance feedback and reference database feedback but the setting is calibrated for an early precision preferred search. For the entry page finding task, we combi...

Reflections on TREC QA

The TREC (later TAC) Question Answering track reinvigorated the question answering research community, fostering extensive research on different question types and finding answers in different kinds of corpora. Parallel evaluations extended the research further to include a variety of languages and media types. In recent years, the TAC QA track evolved into the Knowledge Base Population (KBP) t...

Some Reflections on Intracytoplasmic Morphologically Selected Sperm Injection